o 

(N 



> 



o 
o 



X 



Distributed Rate Allocation Policies 
for Multi-Homed Video Streaming 
over Heterogeneous Access Networks 

Xiaoqing Zhu , Piyush Agrawal*, Jatinder Pal Singh^, Tansu Alpcan-'^ and Bernd Girod* 
Department of Electrical Engineering, Stanford University, Stanford, CA 94305, U.S.A. 
^Deutsche Telekom R&D Laboratories, Los Altos, CA 94022, U.S.A. 
^Deutsche Telekom Laboratories, Ernst-Reuter Platz 7, Berlin 10587, Germany 



Abstract — We consider the problem of rate allocation among 
multiple simultaneous video streams sharing multiple heteroge- 
neous access networks. We develop and evaluate an analytical 
framework for optimal rate allocation based on observed avail- 
able bit rate (ABR) and round-trip time (RTT) over each access 
network and video distortion-rate (DR) characteristics. The rate 
allocation is formulated as a convex optimization problem that 
minimizes the total expected distortion of all video streams. We 
present a distributed approximation of its solution and compare 
its performance against H°° -optimal control and two heuris- 
tic schemes based on TCP-style additive-increase-multiplicative- 
decrease (AIMD) principles. The various rate allocation schemes 
are evaluated in simulations of multiple high-deflnition (HD) 
video streams sharing multiple access networks. Our results 
demonstrate that, in comparison with heuristic AIMD-based 
schemes, both media-aware allocation and H°° -optimal control 
benefit from proactive congestion avoidance and reduce the 
average packet loss rate from 45% to below 2%. Improvement 
in average received video quality ranges between 1.5 to 10.7 dB 
in PSNR for various background traffic loads and video playout 
deadlines. Media-aware allocation further exploits its knowledge 
of the video DR characteristics to achieve a more balanced video 
quality among all streams. 

Index Terms — Distributed rate allocation, multi-homed video 
streaming, heterogeneous access networks 



I. Introduction 

With the proliferation of broadband access technologies 
such as Ethernet, DSL, WiMax and IEEE 802. 1 la/b/g, portable 
devices tend to possess multiple modes of connecting to 
the Internet. Most PDAs provide both cellular and WLAN 
connectivity; laptops are typically equipped with a built-in 
Ethernet port, an 802.1 la/b/g card and a phone jack for dial-up 
connections. Since a multitude of access technologies will con- 
tinue to co-exist, increasing efforts are devoted to the standard- 
ization of architectures for network convergence. Integration of 
heterogeneous access networks has been a major consideration 
in the design of 4G networks |2|, IEEE 802.21 [SJ, and the 
IP Multimedia Subsystem (IMS) platform In addition. 

This work appears in IEEE Transactions on Multimedia, 2009; appli- 
cable IEEE notice can be retrieved from IEEE website. A preliminary 
version of this work was presented in ACM 15th International Confer- 
ence on Multimedia, September 2007. Augsburg, Germany |r|. The au- 
thors can be contacted via email at {zhuxq,piyushag,bgirod} ©Stanford. edu, 
tjatindersingh@telekom.com, and '-tansu.alpcan@telekom.de. 



multi-homed Internet access presents an attractive option from 
an end-host's perspective. By pooling resources of multiple 
simultaneously available access networks, it is possible to 
support applications with higher aggregate throughput, lower 
latency, and better error resiliency |5|. 

In many applications, each end-host or device needs to 
simultaneously support multiple application flows with het- 
erogeneous bit rate and latency requirements. One can easily 
imagine a corporate user participating in a video conference 
call, while uploading some relevant files to a remote server 
and browsing web pages for reference. In the presence of 
many such users, each access network can easily become 
congested with multiple competing application flows from 
multiple devices. The problem of resource allocation arises 
naturally, for determining the source rate of each application 
flow, and for distributing the traffic among multiple simul- 
taneously available access networks. In this work, we focus 
on video streaming applications as they impose the most 
demanding rate and latency requirements. Flows from other 
applications, such as web browsing and file transfer, are treated 
as background traffic. 

Challenges in the design of a rate allocation policy for such 
a system are multi-fold. Firstly, access networks differ in their 
attributes such as available bit rates (ABRs) and round trip 
times (RTTs), which are time-varying in nature. Secondly, 
video streaming applications differ in their latency require- 
ments and distortion-rate (DR) characteristics. For instance, 
a high-definition (HD) video sequence containing dynamic 
scenes from an action movie requires much higher data rate 
to achieve the same quality as a static head-and-shoulder 
news clip for a mobile device. Thirdly, unlike file transfer 
or web browsing, video streaming applications require timely 
delivery of each packet to ensure continuous media playout. 
Late packets are typically discarded at the receiver, causing 
drastic quality degradation of the received video due to error 
propagation at the decoder In addition, the rate allocation 
policy should also operate in a distributed manner to avoid 
the traffic overhead and additional delay in collecting global 
media and network information for centralized computation. 

This paper addresses the above considerations, and investi- 
gates a suite of distributed rate allocation policies for multi- 
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homed video streaming over heterogeneous access networks^ 

• Media-Aware Allocation: When devices have information 
of both video DR characteristics and network ABR/RTT 
attributes, we formulate the rate allocation problem in 
a convex optimization framework and minimize the sum 
of expected distortions of all participating streams. A dis- 
tributed approximation to the optimization is presented, 
to enable autonomous rate allocation at each device in a 
media- and network-aware fashion. 

• H°° -Optimal Control: In the case where media-specific 
information is not available to the devices, we propose 
a scheme based on H°° -optimal control l&J. The scheme 
achieves optimal bandwidth utiUzation on all access net- 
works by guaranteing a worst-case performance bound 
characterizing deviation from full network utilization and 
excessive fluctuations in allocated video rates. 

• AIMD-Based Heuristic: For comparison, we present two 
heuristic rate allocation schemes that react to con- 
gestion in the network by adjusting the total rate 
of each stream following TCP-style additive-increase- 
multiplicative-decrease (AIMD) principle |7|. They differ 
in their manners of how rates are split among multiple 
access networks in accordance with observed ABRs. 

Performance of all four rate allocation policies are evaluated 
in ns-2 |8|, using ABR and RTT traces collected from Ether- 
net, IEEE 802.11b and IEEE 802.1 Ig networks in a corporate 
environment. Simulation results are presented for the scenario 
of simultaneous streaming of multiple high-definition (HD) 
video sequences over multiple access networks. We verify 
that the proposed distributed media-aware allocation scheme 
approximates the results from centralized computation closely. 
The allocation results react quickly to abrupt changes in the 
network, such as arrival or departure of other video streams. 
Both media-aware aUocation and H°°-optimal control schemes 
achieve significantly lower packet delivery delays and loss 
ratios (less than 0.1% for media-aware allocation and below 
2.0% for H°°-optimal control), whereas AIMD-based schemes 
incur up to 45% losses, far exceeding the tolerance level 
of video streaming applications. As a result, media-aware 
allocation improves the average received video quality by 
1.5 - 10.7 dB in PSNR over the heuristic schemes in various 
simulation settings. It further ensures equal utilization across 
all access networks and more balanced video quality among 
all streams. 

The rest of the paper is organized as follows. Section |ll] 
briefly reviews related work in multi-flow, multi-network re- 
source allocation. We present our system model of the access 
networks and expected video distortion in Section|lIIl followed 
by descriptions of the rate allocation schemes in Section II VI 
Performances of the four schemes are evaluated in Section |V] 
via simulations of three HD video streaming sessions sharing 

'while our system model is general enough to accommodate best-effort 
networks such as the Internet, data service over cellular networks and 802.11 
wireless home or corporate networks, it may not apply to scenarios where 
the service provider performs admission control or resource provisioning 
according to traffic load, e.g., in canier grade WLAN networks or properly 
dimensioned UMTS networks for voice services. The extension of the cun'ent 
work to accommodate more general network types and behaviors is an 
interesting area of future research, and goes beyond the scope of this paper. 



three access networks under various traffic conditions and 
latency requirements. 

II. Related Work 

Rate allocation among multiple flows that share a network 
is an important and well-studied problem. Internet applications 
typically use the TCP congestion control mechanism for 
regulating their outgoing rate [7| |9|. For media streaming 
applications over UDP, TCP-Friendly Rate Control (TFRC) is 
a popular choice fTOl fTTI. Several modifications have been 
proposed to improve its media-friendliness |12J. In [131, the 
problem of rate allocation among flows with different utilities 
is studied within a mathematical framework, where two classes 
of pricing-based distributed rate allocation algorithms are 
analyzed. In this work, the notion of utility of each flow 
corresponds to its expected received video quality, measured 
in terms of mean-squared-error (MSE) distortion relative to 
the original uncompressed video signals. We also extend the 
mathematical framework in fT3l to consider rate allocation 
over multiple networks. 

The problem of efficient utilization of multiple networks 
via suitable allocation of traffic has been explored from 
different perspectives. A game-theoretic framework to allo- 
cate bandwidth for elastic services in networks with fixed 
capacities is described in fni-lTSl. Our work, in contrast, 
acknowledges the time-varying nature of the network attributes 
and dynamically updates the allocation results according to 
observed available bit rates and round-trip delays. A solution 
for addressing the handoff, network selection, and autonomic 
computation for integration of heterogeneous wireless net- 
works is presented in |2|. The work, however, does not 
address simultaneous use of heterogeneous networks and does 
not consider wireline settings. A cost-price mechanism is 
proposed for splitting traffic among multiple IEEE 802.11 
access points to achieve end-host multi-homing ifTTI ifTSll . The 
work does not take into account existence of other types of 
access networks or the characteristics of traffic, nor does it 
specify an operational method to split the traffic. In [51, a flow 
scheduling framework is presented for collaborative Internet 
access, based on modeling and analysis of individual end- 
hosts' traffic behavior The framework mainly accounts for 
TCP flows and uses metrics useful for web traffic including 
RTT and throughput for making scheduling decisions. 

Rate adaptation of multimedia streams has been studied 
in the context of heterogeneous networks in 1191 . where 
the authors propose an architecture to allow online measure- 
ment of network characteristics and video rate adaptation via 
transcoding. Their rate control algorithm is based on TFRC 
and is oblivious of the media content. In |20|, media-aware 
rate allocation is achieved, by taking into account the impact of 
both packet loss ratios and available bandwidth over each link, 
on the end-to-end video quality of a single stream, whereas in 
|!2l!il, the rate allocation problem has been formulated for mul- 
tiple streams sharing one wireless network. Unlike our recent 
work where the multi-stream multi-network rate allocation 
problem is addressed from the perspective of stochastic control 
of Markov Decision Processes |22| and robust H°° -optimal 
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to approximate the non-linear increase of packet delay with 
traffic rate over each network: 



(3) 



The value of is estimated from past observations of r„ and 
e„, assuming equal delay on both directions]! 



(4) 



Fig. 1. Middleware functionality in a device. The rate allocation 
module collects the observed media statistics and network character- 
istics (e.g., ABR and RTT), and dictates the rate allocation among 
application streams, over each network interface. 



We note that despite oversimplification in this delay model, 
it is still effective in driving a rate allocation scheme with 
proactive congestion avoidance, as can be verified later by 
simulation results in Section |V] 



control of linear dynamic systems 123)1 ||24 |, in this paper 
we stay within the convex optimization framework for media- 
aware optimal rate allocation, and compare the performance 
of the scheme with prior approaches. Preliminary results from 
this work have been reported in IT] and 125] . 

III. System Model 

In this section, we introduce the mathematical notations 
used for modeling the access networks, and for estimating 
expected received video distortion of each stream. We envi- 
sion a middleware functionality as depicted in Fig. [U which 
collects characteristic parameters of both the access networks 
and video streams, and performs the optimal rate allocation 
according to one of the schemes described in Section |IV] A 
more detailed discussion of the middleware functionality can 
be found in l25l . 

A. Network Model 

Consider a set of access networks TV = {1, 2, . . . , iV}, 
simultaneously available to multiple devices. Each access net- 
work n is characterized by its available bit rate c„ and round 
trip time t„, which are measured and updated periodically. 
For each device, the set of video streams is denoted as 5 = 
{1,2,..., 5}. Traffic allocation can be expressed in matrix 
form: r = {r^jjsxAf, where each element corresponds to 
the allocated rate of Stream s over Network n. Consequently, 
the total allocated rate over Network n is r„ = J^s ™d 
the total allocated rate for Stream s is r'' = ^n- We denote 
the residual bandwidth over Network n as: 

— ^ ^ — ^n- (1) 

s&S 

From the perspective of Stream s, the observed available 
bandwidth is: 

< = c„-^<'. (2) 

Note that e„ = c„ - r„ = cf, - rf^. 

As the allocated rate on each network approaches the maxi- 
mum achievable rate, average packet delay typically increases 
due to network congestion. We use a simple rational function 



B. Video Distortion Model 

Expected video distortion at the decoder comprises of two 
terms: 

ddec — dene ~t~ (^/ossi (5) 

where d^ne denotes the distortion introduced by lossy com- 
pression performed by the encoder, and dioss represents the 
additional distortion caused by packet loss l26| . 

The distortion-rate (DR) characteristic of the encoded video 
stream can be fit with a parametric model l26ll : 

d^irn^d^o + r^^, (6) 

where the parameters dg, 6^ and depend on the coding 
scheme and the content of the video. They can be estimated 
from three or more trial encodings using non-linear regression 
techniques. To allow fast adaptation of the rate allocation 
to abrupt changes in the video content, these parameters are 
updated for each group of pictures (GOP) in the encoded video 
sequence, typically once every 0.5 second. 

The distortion introduced by packet loss due to transmission 
errors and network congestion, on the other hand, can be 
derived from l27l as: 

dloss — '^'^Plossi 

where the sensitivity factor k'^ reflects the impact of packet 
losses pfggg, and depends on both the video content and its 
encoding structure. In general, packet losses are caused by 
both random transmission errors and overdue delivery due to 
network congestion. Since looses over the former type cannot 
be remedied by means of mindful rate allocation, we choose 
to omit its contribution in modeling decoded video distortion. 
For simplicity, pf^^g comprises solely of late losses due to 
network congestion in the rest of this paper. 

-For multi-homed end hosts, acknowledgement packets for traffic sent over 
each network interface are returned over the same network. Therefore RTT is 
a good indication of network congestion, occurring either on the forward or 
backward path. 
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IV. Distributed Rate Allocation 

In this section, we address the problem of rate allocation 
among multiple streams over multiple access networks from 
several alternative perspectives. We first present a convex 
optimization formulation of the problem in Section IIV-AI and 
explain how to approximate the media- and network-aware 
optimal solution with decentralized calculations. In the case 
that video DR characteristics are unavailable, we resort to a 
formulation of H°° -optimal control in Section IIV-BI which 
dynamically adjusts the allocated rate of each stream accord- 
ing to fluctuations in observed network available bandwidth. 
For comparison, we include in Section IIV-CI two heuris- 
tic allocation schemes following TCP-style additive-increase- 
multiplicative-decrease (AIMD) principle. All four schemes 
are distributed in nature, in that the rate allocation procedures 
performed by each stream does not need coordination or syn- 
chronization with other streams. Rather, interactions between 
the streams are implicit, as the ABRs and RTTs observed 
by one stream are affected by the allocated rates of other 
competing streams sharing the same interface networks. 

A. Media-Aware Allocation 

We seek to minimize the total expected distortion of all 
video streams sharing multiple access networks: 

min J2sddecir',P!oss) (8) 

r 

s.t. = Vse5 (9) 

rn = Es<<Cn, "ineN (10) 

< = p„r^ VneAA. (11) 

In ([8]l, the expected distortion d^^^ is a function of the 
allocated rate and average packet loss pf^^^ according to 
(|5]l. The constraint ( fTTI ) is introduced to impose uniqueness of 
the optimal solution. We choose p„ — Cnj 'Ylm' "^n' ensure 
balanced utilization over each interface: 



yneU. (12) 



It can also be shown that p„ — cf^/J^n'^n' G 'S- Each 
stream can therefore calculate the value of pn independently, 
based on its own ABR observation for Network n. 

The average packet loss pf^^^ for each stream is the 
weighted sum of packet losses over all networks: 



PL 



(13) 



Following the derivations in lIZH . the percentage of late 
packets is estimated as e"*"/*", assuming exponential delay 
distributions with average t„ for Network n and playout 
deadline for Stream s. Given (|3]l, pf^^^ is expressed as: 



Plo 



-*0(c^-'"J)/an 



(14) 



Combining ©-(O, it can be easily confirmed that the 
optimization objective is a convex function of the variable 
matrix r. If all the observations and parameters were available 
in one place, the solution could be found by a suitable convex 
optimization method 1281 . 



We desire to minimize the objective (O in a distributed 
manner, with as little exchange of information among the 
devices as possible. One approach is to consider the impact 
of network congestion on one stream at a time, and alternate 
between the streams until convergence. From the perspective 
of Stream s, its contribution to (O can be rewritten as: 

min d^fr") + V„p„e-*««-<)/"" 

+ E„E.'^.Pn«^'e'*°' (15) 
s.t. r'^n — pnr'^ ^'in <E U 

< < <,Vn e TV. 

In dTsl l. optimization of rate allocation for Stream s requires 
knowledge of not only its own distortion-rate function d^{r^) 
and packet loss sensitivity k*, but also its impact on the 
late loss of other streams via the parameters and . 
While each stream can obtain information regarding its own 
packet loss sensitivity and playout deadline, exchange of 
such information among different streams is undesirable for 
a distributed scheme. 

We therefore further simplify the optimization to: 

min d''(r'*) + 2„KVne"*°^'^""''"^/"" (16) 
S.t. rfj — pnT'^y-n e J\f 

< <<,Vne A/", 

where k' is empirically tuned to control the scheme's aggres- 
siveness. Even though ( fT6] l does not necessarily lead to an 
optimal solution for it nevertheless incorporates considera- 
tions of both network congestion and encoder video distortion 
in choosing the optimal rates. The impact on other streams 
is captured implicitly by the second term in (fTSIl.reflecting 
congestion experienced by all streams traversing that network. 
Effectiveness of this distributed approximation will be verified 
later in Section IV-BI 

In essence, optimization of (fTSI l involves a one-dimensional 
search of r*, thus can be solved efficiently using numerical 
methods. Computational complexity of the scheme increases 
linearly with the number of competing streams S and the num- 
ber of available access networks N, on the order of 0{NS). 
In practice, each stream needs to track its observations of c^'s 
and r„'s over all available access networks, and to observe 
its video DR parameters 9'^ and Tq. At each time instance, 
the scheme would update its estimate of q:„ according to dUi. 
It then determines the allocated rate by minimizing ( fTSI l. 
and divides up the rate in proportion to pn over respective 
networks. Figure |2] summarizes these procedures. 

B. H°° -Optimal Control 

In the case when media-specific knowledge is unavailable 
to the wireless devices, the rate allocation problem can be 
addressed using H°°-optimal control [23 1. In this approach, we 
track current and past observations of available bit rate (ABR) 
of each network, and model variations in ABR as unknown 
disturbances to a continuous-time linear system. The design 
goal is to achieve full network utilization while preventing 
excessive fluctuations in allocated video rates. An optimal 
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Input: ABR and RTT measurements of available access 
networks cf,, r„; 



video DR characteristic 9'^ 



'0 



for the current GOP; 



Parameters: level of aggressiveness k'; 

Output: Allocated rate for each access network n; 

foreach Network n available to Stream s do 
I Update estimate of Q!„ according to (HI; 
end 

Update pn as </ J^n 

Update to minimize ( fTSl i: 

foreach Network n available to Stream s do 

I Update rfj as p„r^; 
end 

Fig. 2. Procedures of the media-aware allocation scheme run by 
Stream s. 



rate controller is derived based on H°° -optimal analysis ||6l 
to bound the worst-case system performance. The scheme is 
distributed by nature, in that it treats the dynamics of each 
stream as unknown disturbance for others, thereby decoupling 
interactions between different streams. 

Each stream estimates via various online measurement 
tools II29I the measured residual bandwidth as: 



Wn 



(17) 



J e„, if e„ > 

\^l{tf - U), if e„ < ' 

in which e„ = c„ — rn is defined by ([T]l; and tf denote the 
initial and final time instance when e„ is negative and /i is a 
negative scaling constant. 

We next define a continuous-time linear system from the 
perspective of a single stream keeping track of a single 
network. For notational simplicity we subsequently drop the 
subscript n and omit the time index t. The extension to 
multiple access networks is discussed in the Appendix. Since 
each stream is independent of others in the H°° -optimal control 
formulation, the scheme also generalizes immediately to the 
case with multiple streams Il23l ||24|. 

From the perspective of Stream s, its rate update system 
can be expressed as: 



X 



ax" + bu" + w, 
~(f)r'' + ^t^ 



(18) 
(19) 



where the system state variable x" reflects roughly residual 
network bandwidth for Stream s and represents the rate 
control action. In ( fTSl ). the parameters a < and 6 < adjust 
the memory horizon and the expected effectiveness of control 
actions, respectively, on the system state x" . A smaller value 
of a corresponds to a longer horizon, i.e., smoother values of 
a;* over time. A higher value of h means a more responsive 
system, where the rate control action of an individual stream 
has greater impact on total network utilization. In ( fT9l ), the rate 
update is approximately in proportion to the control action, 
with (/) > sufficiently small to guarantee stability Ii23l ll24l . 
Recall that w is function of residual bandwidth e, which, in 
turn, is function of aggregate rates from all video streams. 



Therefore the evolutions (fTSl ) and ( fT9] l are connected via a 
feedback loop. 

Ideally, if the network is fully utilized at equilibrium, w is 
zero while and approach zero for sufficiently small. 
To prevent excessive fluctuations in the allocated rate of each 
video stream, however, fluctuations in the measured available 
bandwidth cannot be tracked perfectly. Design of the rate 
controller it* therefore needs to balance the incentive for full 
network utilization against the risk of excessive fluctuation in 
allocated video rates. Such design objective can be expressed 
in mathematical terms, in the form of a cost function 



L''(a;*, u*, w) 



(20) 



where :— [hx'^ denotes system output with user- 

specified weights h > Q and g > on relative importance 
of full network utilization and video rate smoothness. In ( l20l i. 
Il^^f := \z"{t)\'^dt and \\wf := \w{t)\^dt. The cost 
function captures the proportional change of the system output 
z'^ with respect to system input w. Intuitively, when variations 
in the observed residual bandwidth w is large, larger variations 
are allowed in the allocated video rates. 

From H°°-optimal control theory f6\, one can choose the 
optimal rate controller as: 

b 



(21) 



with a. 



Xh^)/X and A = I/72 - b^/g^ to 



ensure a worst-case performance factor 7 := sup^, L"{u" , w). 
The lowest possible performance factor is calculated as: 7* — 
\^ (]?■ jlp- + 6^/5^]^-'-. In other words, for any given value of 
7 > 7*, one can find an optimal rate controller according to 
(ISTT i to ensure that in the worst case, the cost function (l20b 
will not exceed 7. 

Although analysis and controller design are conducted 
around the equilibrium point, the streams do not have to com- 
pute the actual equilibrium values. In practice, the H°°-optimal 
rate control scheme is implemented through the procedures 
summarized in Fig. [3] Similar as for media-aware allocation, 
computational complexity of the H°° -optimal control scheme 
scales linearly with number of competing streams and number 
of available access networks, on the order of 0{NS). 



Input: ABR measurements of available access networks; 
Parameters: Stream-specific weighting parameters (a, b) 
and {h,g); 

Output: Feedback control and allocated rate r*; 

foreach Access network available to Stream s do 
Measure current ABR (w) and delay; 
Update x'^ according to ( fTsl ); 
Compute according to ( 1211 1; 
Update rate according to ( fT9] ); 
end 



Fig. 3. Procedures of the H°° -optimal rate control scheme run 
by Stream s. 
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congestion 




Time t 

Fig. 4. Illustration of AIMD-based heuristic schemes. Allocated 
rate for each stream r" keeps increasing at a rate of Ar" /At until 
congestion is detected from packet losses or excessive round trip 
delay. In that case, the rate is cut down by (r^ — r^„j,j)/2 over 
the congestion network n. 




Fig. 5. Topology for network simulations 



C. AIMD-Based Heuristics 

For comparison, we introduce in this section two heuris- 
tic rate allocation schemes based on the additive-increase- 
multiplicative-decrease (AIMD) principle used by TCP con- 
gestion control |7i. Instead of performing proactive rate allo- 
cation by optimizing a chosen objective according to observed 
network attributes and video characteristics, the AIMD-based 
schemes are reactive in nature, in that they probe the network 
for available bandwidth and reduce the allocated rates only 
after congestion is detected. 

As illustrated in Fig. HI each stream initiates at a specified 
rate corresponding to the minimum acceptable video 

quality, and increases its allocation by Ar* every Ai seconds 
unless network congestion is perceived, in which case the 
allocated rate is dropped by (r^ — f mi„)/2 over the congested 
network n. 

We consider two variations of the AIMD-based schemes. 
They differ in how the total allocated stream rate r** is dis- 
tributed across multiple access networks during the additive- 
increase phase: 

• Greedy AIMD: The increase in rate allocation Ar** is 
allocated to the network interface offering the maximum 
instantaneous available bit rate: r,^ = r*, if cfj > 

• Rate Proportional AIMD: The increase in rate allocation 
Ar* is allocated to all available networks in proportion 
to their instantaneous available bit rates rt. — . . 

In both schemes, congestion over Network n is indicated upon 
detection of a lost packet or when the observed RTT exceeds a 
prescribed threshold t^^. The value of r^"^, in turn, is adjusted 
according to the video playout deadline. 



V. Performance Evaluation 

A. Simulation Methodology 

Performance of all four rate allocation policies are evaluated 
in ns-2 |8|, for an example network topology shown in 
Fig. |5] Each sender streams one HD video sequence via all 
three access networks to its receiver Rate allocation over 
each network is determined by the middleware functionality 
depicted in Fig. [T| We collect available bit rate (ABR) and 
round-trip-time (RTT) measurement from three real-world ac- 
cess networks (Ethernet, 802.11b and 802. llg) in a corporate 
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Fig. 6. Statistics (a) and sample trace segments (b) of measured 
Available Bit Rate (ABR) and round-trip-time (RTT) from Deutsche 
Telekom Laboratories to Stanford University. The traces are collected 
over a two-hour duration in a week day afternoon. 



environment using Abing (29] |l30|li| The ABR and RTT 
values are measured once every 2 seconds. The traces are then 
used to drive the capacity and delay over each simulated access 
network in ns-20 Statistics of the network measurement, 
together with a sample segment of the measured traces are 
presented in Fig. |6] Figure |7] shows how average packet 
delivery delay varies with utilization percentage over each 
access network, as well as sample packet delay distributions 
at a given utilization level. In all three interface networks, the 
average packet delay increases drastically as the utilization 
level approached 100%, as described in (O. In accordance 

^In both 802.11b and 802. llg networks, the transmission rate over each 
interface is automatically adjusted according to wireless channel conditions. 
The effect of link rate adaptation is reflected in fluctuations in the ABR traces 
observed by Abing. Note that the rate allocation schemes under discussion 
only passively react to, instead of interact with, such fluctuations. 

^Both forward and backward trip delays are simulated as half of measured 
RTTs. 





(a) Ethernet (b) 802.11b (c) 802. llg 

Fig. 7. Average packet delivery delay as function of network 
utilization (top), as well as example packet delay distributions at a 
given utilization level (bottom), from the three interfaces used in 
ns-2 simulations. The packet delay distributions are plotted with 
a utilization level of 87%, 88%, and 88% over the three interfaces, 
respectively. 
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with our assumptions, the example packet delay distributions 
also exhibit exponential shapes. We refer to [22| for further 
details of the trace collection procedures and bandwidth and 
delay measurements using Abing. 

Three high-definition (HD) video sequences: Bigships, Cy- 
clists, Harbor are streamed by three senders, respectively. The 
sequences have spatial resolution of 1280 x 720 pixels, and 
temporal resolution of 60 frames per second (fps). Each stream 
is encoded using a fast implementation of the H.264/AVC 
codec |[3T1 ll32l at various quantization step sizes, with GOP 
length of 30 and IBBP... structure similar to that often used 
in MPEG-2 bitstreams. Figure [8] shows the tradeoff of en- 
coded video quality measured in MSB distortion and PSNR 
versus average bit rate over the entire sequence durations. 
The measured data points are plotted against fitted model 
curves according to (|6|. Encoded video frames are segmented 
into packets with maximum size of 1500 bytes. Transmission 
intervals of each packet in the entire GOP are spread out 
evenly to avoid unnecessary queuing delay due to the large 
sizes of intra coded frames. 

In addition to the video streaming sessions, additional 
background traffic is introduced over each network interface 
by the exponential traffic generator in ns-2. The background 
traffic rate varies between 10% and 50% of the total ABR 
of each access network. We also employ an implementation 
of the Abing agent in ns-2 to perform online ABR and 
RTT measurement over each access network for each stream. 
This allows the simulation system to capture the interaction 
among the three competing HD streams as they share the three 
access networks simultaneously. For consistency, measurement 
frequency of the Abing agents in ns-2 is also once every 
2 seconds. Update of video rate allocation is in sync with the 
time instances when new network measurements are obtained 
for each stream. Note that no coordination or synchronization 
is required across rate updates in different streams, due to the 
distributed nature of the rate allocation schemes. 

In the following, we first focus on the media-aware al- 
location scheme. Its allocation results are compared against 
optimal solutions for ( fT5] ) in Section IV-BI and its conver- 
gence behavior is compared against H°° -optimal control in 
Section IV-CI Performance of all four allocation schemes are 
evaluated with 20% of background traffic load over each 
network and a playout deadline of 300 ms in Section IV-DI 
Section IV-EI compares allocation results from networks with 
or without random packet losses. The impact of background 
traffic load on the allocation results obtained from different 
schemes is studied in Section lvn The effect of different video 
streaming playout deadlines is investigated in Section IV-GI 

B. Comparison with Optimal Allocation 

We first verify how well the distributed solution from ( fTSI l 
can approximate optimal solution for ( fTSl l. Figure |9] compares 
the traces of allocated rate to each video stream calculated 
from both solutions. The value of k' used in the distributed 
approximation corresponds to the sum of for all three 
streams: k' = k". It can be observed that allocation 
from the distributed approximation tracks the optimal solution 
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Fig. 8. Rate-distortion (a) and rate-PSNR (b) curves of 3 HD video 
sequences used in the experiments: Bigships, Cyclists and Harbor, all 
encoded using the H.264/AVC codec at 60 frames per second, GOP 
length of 30. The measured data points obtained from encoding are 
plotted against model curves fitted according to 
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Fig. 9. Comparison of allocated rate to each video stream, from 
the optimal solution for l il5b and its distributed approximation ( 116b . 
Background traffic load is 20% and the playout deadline is 300 ms. 



closely. Since the congestion term in (fTSl l ignores the impact 
of a stream on the expected distortion of other streams, the 
distributed approximation achieves slightly higher rates. 



C. Comparison of Convergence Behavior 

Figure [TO] shows traces of allocated rate, when the number 
of competing streams over the three access networks increases 
from 1 to 3. In this experiment, all three streams are the 
Harbor HD video sequence, hence the allocated rate to each 
stream is expected to be the same after convergence. The 
second and third streams start at 50 and 100 seconds, and 
complete at 200 and 250 seconds respectively. Correspond- 
ingly, abrupt drops and rises in allocated rate can be observed 
in Fig. [To] (a) for media-aware allocation. It is also interesting 
to note the fluctuations in the allocated rates after convergence, 
reflecting slight variations in the video contents and network 
attributes. The H°°-optimal control scheme, on the other hand, 
requires longer time for the allocation to converge, as shown 
in Fig.[IO](b). 

Next, we measure the allocation convergence times when 
1, 2 or 3 competing streams join the network simultaneously. 
Convergence time is defined as the duration between the start 
of the streams and the time at which allocated video rates 
settle between adjacent quality levels. Figure [TT] compares re- 
sults from media-aware allocation against H°°-optimal control. 
While both schemes yield similar allocated rates and video 
qualities, convergence time from media-aware allocation is 
shorter than H°° -optimal control. 
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Fig. 10. Trace of total allocated rate to each stream, as the number 
of competing video streams, all Harbor, increases from 1 to 3. 
Baclcground traffic load is 20% and the playout deadline is 300 ms. 
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Fig. 11. Convergence time and corresponding average video quality, 
achieved by media-aware and H°° -optimal control schemes, with 
1, 2, or 3 competing streams of the HD video sequence Harbor. 
Background traffic load is 20%; the playout deadline is 300 ms. 



D. Comparison of Allocation Traces 

Figure [12] plots the traces of aggregate rate allocated over 
the Ethernet interface for all four allocation schemes, together 
with the available bit rate over that network. It can be observed 
in Fig. [12] (a) that media-aware allocation avoids much of the 
fluctuations in the two AIMD-based heuristics. Figure [12] (b) 
shows that it achieves higher network utilization than H°°- 
optimal control, as the latter is designed to optimize for the 
worst-case scenario. Similar observations also hold for traces 
of aggregate allocated rate over the other two interfaces. 

In Fig. [T3] we compare the traces of total allocated rate 
for each video stream, resulting from the various allocation 
schemes. In greedy AIMD allocation, the total rate of each 
stream increases until multiplicative decrease is triggered by 
either packet losses or increase in the observed RTTs from 
one of the interfaces. Therefore traces of the allocated rates 
bear a saw-tooth pattern. Behavior of the rate proportional 
AIMD scheme is similar, except that rate drops tend to occur 
at around the same time. The H°° -optimal control scheme 
yields less fluctuations in the allocated rates. In both the rate 
proportional AIMD allocation and the H°° -optimal control 
schemes, allocated rates are almost identical to each video 
stream, since all flows are treated with equal importance. 
The media-aware convex optimization scheme, in contrast, 
consistently allocates higher rate for the more demanding 
Harbor stream, with reduced allocation for Cyclists with less 
complex contents. 




(a) 

Fig. 12. Trace of aggregated rate over the Ethernet interface, (a) 
Media-aware allocation versus AIMD-based heuristics; (b) Media- 
aware allocation versus H°° -optimal control. In this experiment, 
background traffic load is 20% and the playout deadline is 300 ms. 
The network available bit rate is also plotted as a reference. 
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Fig. 13. Trace of allocated rate to each video stream, aggregated 
over three interfaces. Background traffic load is 20% and the playout 
deadline is 300 ms. 



E. Impact of Random Packet Loss 

Figure [14] compares the average utilization over each inter- 
face, allocated rate to each stream, and corresponding received 
video quality achieved by the four allocation schemes, for 
background traffic load of 30%. The media-aware scheme 
allocates lower rate for Cyclists and higher rate for Harbor, 
compared to the other schemes. This improves the video 
quality of Harbor, the stream with the lowest PSNR amongst 
the three, at the expense of reducing the quality of the less 
demanding Cyclists. Consequently, the video quality is more 
balanced among all three streams. 

A similar graph is shown in Fig. [15] for the same simulation 
with 1% random packet loss over each network interface. 
While the presence of random packet losses tend to reduce re- 
ceived video quality, its impact cannot be mitigated by means 
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Fig. 14. Comparison of allocation results from different schemes with 
background traffic load of 30% and playout deadline of 300 ms. 
Aggregated network utilization over each interface (top); allocated 
video rate for each stream (middle); received video quality in PSNR 
(bottom). 
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Fig. 15. Comparison of allocation results from different schemes 
with background traffic load of 30% and playout deadline of 300 ms. 
There is 1% of random packet loss over each interface. Aggregated 
network utilization over each interface (top); allocated video rate for 
each stream (middle); received video quality in PSNR (bottom). 



of careful rate allocation. Consequently, relative performance 
of the four rate allocation schemes remain the same in both 
scenarios. This justifies the absence of a term representing 
random packet losses when formulating the media-aware rate 
allocation problem. For the rest of the simulations, we there- 
fore focus on comparisons without random packet losses. 

F. Varying Background Traffic Load 

Next, we vary the percentage of background traffic over 
each network from 10% to 50%, with playout deadline of 
300 ms. The impact of the background traffic load on the 
allocation results is shown in Fig. [16] It can be observed 
that total utilization over each interface increases with the 
background traffic load. For the media-aware, H°° -optimal 
and rate proportional AIMD schemes, utilization varies 
between 60% to 90%, whereas for the greedy AIMD scheme, 
the 802.11b interface is underutilized@ Note that media-aware 
allocation ensures balanced utilization over all three access 
networks, as dictated by ( fT2b . 

^Since 802.11b has significantly lower ABR than the other two interfaces, 
it is never chosen by the greedy AIMD scheme. 




(a) 



(b) 



Fig. 17. Average packet delivery delay (a) and packet loss ratio (b) 
at the receiver for each video stream, with background traffic load at 
10%, 30% and 50%, respectively. The playout deadline is 300 ms. 
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Fig. 18. Received video quality in PSNR for Bigships, Cyclists 
and Harbor, for background traffic load at 10%, 30% and 50%, 
respectively. The playout deadline is 300 ms. 



It can be observed from Fig. [T6]that, increasing background 
traffic load leads to decreasing allocated rate in each stream. 
While the other three schemes treat the three flows with equal 
importance, the media-aware allocation consistently favors the 
more demanding Harbor, thereby reducing the quality gap 
between the three sequences. The two AIMD-based heuristics 
achieve lower received video quality than media-aware and 
H°°-optimal allocations, especially in the presence of heavier 
background traffic load. 

Figure [17] compares the average packet delivery delay and 
packet loss ratios due to late arrivals. In the two AIMD-based 
schemes, allocated rates are reduced only after congestion 
has been detected. The media-aware allocation and the H°°- 
optimal control schemes, on the other hand, attempt to avoid 
network congestion in a proactive manner in their problem 
formulations. They therefore yield significantly lower packet 
loss ratios and delays. This leads to improved received video 
quality, as shown in Fig. [18] The performance gain ranges 
between 1.5 to 8.8 dB in PSNR of the decoded video, 
depending on the sequence content and background traffic 
load. Note also, that the packet delivery delays and packet loss 
ratios also indicate the impact of each scheme on background 
traffic sharing the same access networks. Lower delays and 
losses achieved by the media-aware and H°°-optimal schemes 
means that they introduce less disruption to ongoing flows, as 
a results of proactive congestion avoidance. 

G. Varying Playout Deadline 

In the next set of experiments, we vary the playout deadline 
for each video stream from 200 ms to 5.0 seconds, while 
fixing the background traffic load at 20%. Figure [19] compares 
the allocation results from the four schemes. As the playout 
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Fig. 16. Comparison of allocation results from different schemes, as the background traffic load increases. 



deadline increases, higher network congestion level can be 
tolerated by each video stream. The media-aware allocation 
scheme therefore yields higher allocated rate and improved 
video quality, saturating as the playout deadline exceeds 
1.0 second. Allocation from the other three media-unaware 
schemes, in comparison, are not so responsive to changes in 
the playout deadlines of the video streams. 

Figures |20] and [21] compare the average packet delivery 
delay and packet loss ratios due to late arrivals. Similar to 
results in the previous section, the media-aware and 
optimal allocations achieve much lower packet delivery delays 
and loss ratios than the two AIMD-based heuristics. The 
performance gap increases as the playout deadline becomes 
more relaxed. The packet loss ratios are almost negligible 
(less than 0. 1 %) from media-aware allocation, and very small 
(less than 2.0%) from H°°-optimal control. In comparison, 
the packet loss ratios range between 16 - 45% for greedy 
AIMD, and between 12 - 37% for rate proportional AIMD 
allocation, far exceeding the tolerance level of video streaming 
applications. Consequently, while the average received video 
quality of Bigships at playout deadline 300 ms is 34.0 dB and 
32.8 dB from the greedy and rate proportional AIMD schemes, 
respectively, they are improved to 37.3 dB with media-aware 
allocation, and to 36.0 dB with H°°-optimal control. Similar 
results are observed for other sequences with other playout 
deadlines, as shown in Fig. |22] The improvement varies 
between 3.3 - 10.7 dB in PSNR of the decoded video. The 
lower packet delivery delays and packet loss ratios achieved 
by the two proposed schemes also indicate that they are more 
friendly to ongoing background traffic than the two AIMD- 
heuristics, by virtue of more mindful congestion avoidance. 
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Fig. 20. Average packet delivery delays of each video stream for 
playout deadlines ranging from 200 ms to 5.0 s, with 20% background 
traffic load. 
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Fig. 21. Average packet loss ratios of each video stream for playout 
deadlines ranging from 200 ms to 5.0 s, with 20% background traffic 
load. 
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Fig. 19. Comparison of aggregated network utilization over each interface and allocated rate of each stream, as the playout deadline increases 
from 200 ms to 5.0 second. Background traffic load is 20%. 
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Fig. 22. Received video quality in PSNR of Bigships, Cyclists and 
Harbor for playout deadlines ranging from 200 ms to 5.0 s, with 
20% background traffic load. 



VI. Conclusions 

This paper addresses the problem of rate allocation among 
multiple video streams sharing multiple heterogeneous access 
networks. We present an analytical framework for optimal rate 
allocation based on observed network attributes (available bit 
rates and round-trip times) and video distortion-rate (DR) char- 
acteristics, and investigate a suite of distributed rate allocation 
policies. Extensive simulation results demonstrate that both 
the media-aware allocation and H°° -optimal control schemes 
outperform AIMD-based heuristics in achieving smaller rate 
fluctuations, lower packet delivery delays, significantly re- 
duced packet loss ratios and improved received video quality. 
The former benefit from proactive avoidance of network 
congestion, whereas the latter adjust the allocated rates only 



reactively, after detection of packet drops or excessive delays. 
The media-aware approach further takes advantage of explicit 
knowledge of video DR characteristics, thereby achieving 
more balanced video quality and responding to more relaxed 
video playout deadline by increasing network utilization. 

We believe that this work has some interesting implications 
for the design of next generation networks in a heterogeneous, 
multi-homed environment. Media-aware proactive rate alloca- 
tion provides a novel framework for quality-of-service (QoS) 
support. Instead of rigidly reserving the network resources 
for each application flow in advance, the allocation can be 
dynamically adapted to changes in network conditions and 
media characteristics. As the proposed rate allocation schemes 
are distributed in nature, they can be easily integrated into 
wireless devices. Future extensions to the current work include 
investigation of measures to best allocate network resources 
among different traffic types (e.g., web browsing vs. video 
streaming) and to reconcile their different performance metrics 
(e.g., web page refresh time vs. video quality) as functions of 
their allocated rates. In addition, our system model can be 
further extended to incorporate other types of access networks 
employing resource provisioning or admission control. 

Appendix 

We now provide the H°°-optimal control formulation for the 
general case of multiple access networks from the perspective 
of a single stream s E S. For ease of notation, we drop the 
superscript s and define x := [xn], i" := [rn], and u :— [-u„] 
for all n E Af. The counterpart of the system ( fTsl l and (19[ is 
given by: 

f = -$r + u, 
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where w := [w„] Vn. Here, the matrices A, B, and $ are 
obtained simply by multiplying the identity matrix by a, b, 
and 0, respectively. 

Correspondingly, system output is: 

z := Fx + Gu, (23) 

The matrix H represents the weight on the cost of deviation 
from zero state, i.e. full network utilization. We can assume 
that Q := H^H is positive definite, in that any non-zero de- 
viation from full utilization leads to a positive cost. Likewise, 
the matrix G represents the weight on the cost of deviation 
from zero control, i.e., constant allocated rates. We assume 
that G^G is positive definite, and that no cost is placed on 
the product of control actions and states: H^G = 0. 
The cost function is defined as: 

L(x,u,w) = M, (24) 

l|w|| 

where \\zf := \z{t)\^dt and ||w||2 \^^{t)\^dt. 
Again, one can define the worst possible value for cost L 
as 7*. 

Similar to the solutions for the scalar system, we obtain 
the H°° -optimal linear feedback controller for the multiple 
network case: 

-(G^G)-iB^I]^x. (25) 

In ( |25] |, the matrix E-^ can be computed by solving the game 
algebraic Ricatti equation (GARE): 

A^Z+ZA-Y.{B{G^Gy^B'^~'-/-^DD'^)j: + Q = 0. (26) 

It can be verified that a unique minimal nonnegative definite 
solution S-y exists for 7 > 7*, if (A, B) is stabilizable and 
{A,H) is detectable |6|. In our case, since the matrix B 
is square and negative definite and the matrix Q is positive 
definite, the system is both controllable and observable, hence 
both conditions are satisfied. 
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